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Abstract. Dempster’ s rule of combination is commonly used in the field of infor- 
mation fusion when dealing with belief functions. However, it generally requires a 
high computational cost. To reduce it, a basic belief assignment (bba) 
approxima-tion is needed. In this paper we present a new bba approximation 
approach called hierarchical proportional redistribution (HPR) allowing to 
approximate a bba at any given level of non- specificity. Two examples are given 
to show how our new HPR works. 



1 Introduction 

Dempster-Shafer Theory (DST), also called Theory of Evidence [10], has been 
widely used in many applications, e.g., information fusion, pattern recognition and 
decision making [11]. Although it is appealing in uncertainty modeling, while ap- 
pearing more controversial for consistent reasoning, the high computational cost 
remains problematic which is often raised against its use [11]. To resolve such a 
problem, three major types of approaches have been proposed. 

The first is to propose efficient procedures for performing exact computations 
[1, 8]. The second is composed of Monte-Carlo techniques [9]. The third is to 

approximate a belief function to a simpler one. The papers of Voorbraak [13], 
Dubois and Prade [5] are seminal works of this type. Other representative works 
include k-l-x [3] and k-additive belief function [2, 6]. Denceux uses hierarchical 
clustering to implement the inner and outer approximation [3]. 
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In this paper, we propose a new method called hierarchical proportional redistri- 
bution (HPR) to approximate any general basic belief assignment (bba) at a given 
level of non-specificity [4], up to the ultimate level 1 corresponding to a Bayesian 
bba [10]. The level of non- specificity can be controlled by the users through the 
adjustment of the maximum cardinality of remaining focal elements. For the ap- 
proximated bba obtained by HPR, the maximum cardinality of the focal elements 
is k. Thus HPR can be considered as a generalized ^-additive belief approximation. 
Some examples are given to show how our proposed HPR method works, and to 
compare it with other approximations. 



2 Basics of Dempster-Shafer Theory (DST) 

In DST [10], the frame of discernment (FoD) is a set 0 of mutual exhaustive and 
exclusive elements. m(.) : 2 0 [0, 1] is a basic belief assignment (bba), also called 

mass function, if it satisfies 



Iac e m(A) = l,m(0)=O. (1) 

Belief function (Bel) and plausibility function (PI) are defined as 



Bel(A) = ^ BQA m(B) and Pl(A) = I An ^ 0 m(B). (2) 



Suppose that are n bba’s, then Dempster’s rule of combination is de- 

fined by 



m(A) 



0, A = 0 

I n mi{Ai) 

PI Aj=A 1 <i<n 

I n 

f~t Aj-^0 1 <i<n 



A^0 



(3) 



This rule is used in DST to combine pieces of evidence expressed by bba’s. As re- 
ferred above, Dempster’s combination has high computational cost and three types 
of approaches have been proposed to reduce it. We prefer belief approximation ap- 
proaches [2, 3,6, 12] since they both reduce the computational cost of the combina- 
tion and allow to deal with smaller- size focal elements, which is more intuitive for 
human to catch the meaning and interpret fusion results [2] . 



3 Two bba Approximation Approaches 

1) k — / — x approximation: This was proposed by Tessem [12]. The simplified bba 
obtained by k-l-x approach satisfies: a) keep no less than k focal elements; b) keep 
no more than l focal elements; c) the mass assignment to be deleted is no greater 
than x. In k-l-x, the focal elements of a original bba are sorted by their masses. 
Such an algorithm chooses the first p focal elements such that k< p <1 and such 
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that the sum of the masses of these first p focal elements is no less than 1-x. The 
deleted masses are redistributed to the other focal elements through a normalization. 



2) ^-additive belief function approximation: Given m(.) : 2 0 [0, 1], one kind of 

k - additive belief function [2, 6] induced by the mass m(.) is defined by 

\m k (B)=m(B)+ X , V|g| <k 

< ADfi,AC0,|A|>& ^ (4) 

\m k (B)= 0, M\B\>k 

where B CO and 



^(WA)=I 

7=1 



■J= I 



|A|! 



'i(y-l)!(|A|-j)! 



(5) 



is the average cardinality of the subsets of A of size at most k. For ^-additive belief 
approximation, the maximum cardinality of available focal elements is no greater 
than k. Other bba approximation methods can be found in related references. 



4 Hierarchical Proportional Redistribution Approximation 



In this paper we propose a new bba approximation approach called hierarchical 
proportional redistribution (HPR), which provides a new way to reduce step-by- 
step the mass committed to uncertainties. Ultimately an approximate measure of 
subjective probability can be obtained if needed, i.e. a so-called Bayesian bba in 
[10]. Our proposed procedure can be stopped at any step in the process and thus it 
allows to reduce the number of focal elements of a given bba in a simple manner to 
diminish the size of the core [10] of a bba. Thus we can reduce the complexity (if 
needed) when applying also some complex rules of combinations. By using HPR, 
we can obtain approximate bba’s at any different non-specificity level that we want. 
Let us first introduce two new notations for convenience and conciseness: 



1 . Any element of cardinality 1 < k < n of the power set 2 0 will be denoted X (k) 
by convention. For example, if 0 = {A,5,C}, then X(2) can denote the following 
partial uncertainties A U B, A U C or B U C, and X(3) denotes the total uncertainty 
AUBUC. 

2. The proportional redistribution factor (ratio) of width a involving elements X and 
Y of the powerset is defined by (for X ± 0 and Y ± 0) 



R S (Y,X)± 



ra(y) + £ • \X\ 

I rex m(Y) +e-\X\ 

\X\-\Y\=s 



( 6 ) 



where £ is a small positive number introduced here to deal with particular cases 
where X ycx m(Y) = 0. 

w-\y\=s 

By convention, we will denote R(Y,X) = R\(Y,X) when we use the proportional 
redistribution factors of width a = 1, as we use in this paper for this HPR method. 
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The HPR is a step-by-step (recursive) proportional redistribution of the mass m(X (k)) 
of a given uncertainty X ( k ) (partial or total) of cardinality 2 < k < n to all the least 
specific elements of cardinality k- 1, i.e., to all possible X(k- 1), until k = 2 is 
reached. The proportional redistribution is done from the masses of belief com- 
mitted to X(k— 1) as done classically in DSmP transformation. The “hierarchical” 
masses m/ z (.) are recursively (backward) computed as follows. Here m h ^ represents 
the approximate bba obtained at the step n-k of HPR, i.e., it has the maximum focal 
element cardinality of k. 

mn^Xin- 1)) = m(X(n- 1)) + S x(n)DX(„- 1), [m(X(n)) -R(X(n- l),X(n))]; 

X(n),X(n- l)e2® (7) 

m h(n-l)( A ) = m(A),\/\A\ <n- 1 

m h( n - 1 ) (0 is the bba obtained at the first step of HPR (n - (n - 1) = 1), the maximum 
focal element cardinality of mu n ^ is n — 1. 

m h ( n -2)iX{n-2))=m{X{n-2)) 

+ E x(«-1)dx(«-2) l m h(n-i)(X{n— 1)) -R(X(n — 2),X(n— 1))] ,gs 
X(n-2),X(n-l)e2 0 

m h(n— 2) (A) ^ — 2 

m h( n - 2 ) (0 is the bba obtained at the second step of HPR (n - (n - 2) = 2), the maxi- 
mum focal element cardinality of m h ^ n _ 2 ) is n - 2. 

This hierarchical proportional redistribution process can be applied similarly (if 
one wants) to compute m h{n _ 3) (.), m h{n _ 4) (.), m h(2) {-), with 

m h(2) (X(2)) = m(X(2))+Z x{3)dX{2) [m h{3) (X(3)) ■ R(X(2),X(3))} 

X(3),X(2)e2 s (9) 

m h (2) ( A ) = ™ h {3) i A ) . V|A | < n - 2 

m h{ 2 )(‘) is the bba obtained at the first step of HPR (n- 2), the maximum focal 
element cardinality of m h ^ 2 ) is 2. 

Mathematically, for any X(l) e 0, i.e. any Q t e 0 a Bayesian belief function can 
be obtained by HPR method in deriving all possible steps of proportional redistri- 
butions of partial ignorances in order to get 

m hm (X(l))=m(X(l))+ X [m h{2) (X(2))-R(X(l),X(m (10) 

X(2)DX(1) 

X(1),X(2)G2 0 

In fact, is a probability transformation, called here the Hierarchical DSmP 

(HDSmP). Since X(n) is unique and corresponds only to the full ignorance 6\ U 0 2 U 
. . . U Q n , the expression of rrih(X(n - 1)) in Eq.(9) just simplifies as 

m hin _ l) {X{n-l)) = m h {X{n-l))^m(X(n))^R(X{n-l) : X{n)) ( 11 ) 

For the full proportional redistribution of the masses of uncertainties to the elements 
least specific involved in these uncertainties, no mass is lost during the step-by-step 
hierarchical process and thus at any step of HPR, the sum of masses is kept to one. 
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5 Examples 
5.1 Example 1 

Let’s consider the following bba over 0 = {0i , 02, ^3}- 

m(0i) = O.lO, m( 02 ) = O-17, m( 03 )=O.O 3 , m(6\ U 62) = 0.15, 

m(6i U 63 ) = 0.20, 171(62 U 62 ) = 0.05, m(6\ U 62 U 03 ) = 0.30. 

We apply the HPR with e = 0 in this example because there is no mass of belief 
equal to zero. It can be verified that the result obtained with small positive e param- 
eter remains (as expected) numerically very close to what is obtained with e = 0. 

• Step 1 : The first step of HPR consists in redistributing back m(6\ U 62 U 63) = 0.30 
committed to the full ignorance to the elements 6\ U 62, 0i U 03 and 62 U £3 only, 
because these elements are the only elements of cardinality 2 that are included in 
0i U 02 U 03 . Applying the Eq. (8) with n = 3, one gets when X(2) = 0i U 02 , 0i U 03 
and 0i U 02 the following masses. 

m h{ 2 ) (0i U 0 2 ) = m(0i U 0 2 ) + m(X(3)) • R(0i U 0 2 ,X(3)) = 0. 15 + (0.30 • 0.375) = 0.2625 

because R(6\ U 02,X(3)) = 0 . 15 + 0 . 20 + 0.05 = 0-375. 

Similarly, one gets 

m A ( 2 ) (0i U 0 3 ) = m(0i U 0 3 ) + m(X(3)) R(6 X U 0 3 ,X( 3)) = 0.20+ (0.30 • 0.5) = 0.35 
because R(6\ U 0 3 , X(3)) = 0 15+0 20+0 05 = an d a ^ so 

m h{ 2 ) (02 U 0 3 ) = 171(62 U 0 3 ) + m(X(3)) R(6 2 U 63, X( 3)) = 0.05 + (0.30-0.125) = 0.0875 
because R{d 2 U d 3 , X(3)) = 0 . 15 + 0 : 20 + 0.05 = °- 125 - 

• Step 2 Now, we go to the next step of HPR principle and one needs to redistribute 
the masses of partial ignorances X(2) corresponding to 0i U 02, 0i U 03 and 62 U 03 
back to the singleton elements X(l) corresponding to 0i, 62 and 03. We use Eq. (10) 
for doing this as follows: 

m h{ i)(0i) =m(6\)+m h (6i U 02 ) R(6\,6\ U 02 ) +m h (6i U 03 ) -R(0i, 0i U 03 ) 

^0.10 + (0.2625 • 0.3703) + (0.35 • 0.7692) =0.10 + 0.0972 + 0.2692 = 0.4664 

because R( 0i, 0i U 02) = Q 17 « 0.3703 andR(0i, 0i U 03) = Q Q3 « 0.7692 

Similarly, one gets 

=m(0 2 )+m/ z (0i U0 2 ) -R(02,0 i U02)+m/ z (0 2 U03) -R(02,02U0 3 ) 

« 0. 10 ■ + (0.2625 • 0.6297) + (0.0875 • 0.85) =0.17 + 0. 1653 + 0.0744 = 0.4097 

because R(6 2 , 0i U 6 2 ) = 0 17 « 0.6297 and R(6 2 , 6 2 U 03 ) = Q Q3 = 0.85. and 

also 

m h( 1)(%) = m (Q?>)+ m h(Ql U03) -^(03,01 U03)+m/j(0 2 U03) -R(03,0 2 U03) 

« 0.03 + (0.35 • 0.2307) + (0.0875 • 0. 15) =0.03 + 0.0808 + 0.0131 =0.1239 
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because i?(0 3 , 0 j u 63) = 01 g ^ 03 « 0.2307 and i?(0 3 , 6 2 U 63) = 01 ^ 03 = 0.15 
Hence, the result of final step of HPR is: 



m h{ 1 ) (0i ) =0.4664, m h ^(0 2 ) = 0.4097, m h ^(0 3 ) = 0.1239. 

We can easily verify that m h ^{Q\) -\-m h r^(02) +mh(\)(fh) = 1- 

To compare HPR with the approach of k - 1 - x, we set the parameters of k-l—x 
to obtain bba’s with equal focal element number with HPR at each step. In Example 
1, for HPR at first step, it can obtain a bba with 6 focal elements. Thus we set 
k = l = 6 ,x = 0.4 for k — l -x to obtain a bba with 6 focal elements. Similarly, for HPR 
at second step, it can obtain a bba with 3 focal elements. Thus we set k = l = 3, * = 0.4 
for k-l—x. Based on HPR and k — l—x , the results are shown in Table 1 . 



Table 1 Experimental results of Example 1 . 



Focal elements 


m h(k){’) ~ approximate bba 


m(-) obtained by k — l—x 


k = 3 


k = 2 


k= 1 


k = l = 6 


k = l = 3 


0i 


0.1000 


0.1000 


0.4664 


0.1031 


0.0000 


#2 


0.1700 


0.1700 


0.4097 


0.1753 


0.2573 


03 


0.0300 


0.0300 


0.1239 


0.0000 


0.0000 


01 u 02 


0.1500 


0.2625 


0.0000 


0.1546 


0.0000 


01 U 0 3 


0.2000 


0.3500 


0.0000 


0.2062 


0.2985 


02 U 0 3 


0.0500 


0.0875 


0.0000 


0.0515 


0.0000 


01 U 02 U 03 


0.3000 


0.0000 


0.0000 


0.3093 


0.4478 



5.2 Example 2 

Let’s consider 0 = {0 l5 0 2 , 0 3 }, and the bba m(0 3 ) = 0.7 and m(Q\ U 62 U 0 3 ) = 0.30. 
Here, the masses of all the focal elements with cardinality size 2 equal to zero. 
For HPR, when e > 0, m(Q\ U O 2 U 63 ) will be divided equally and redistributed to 
{0i U 62}, {0i U 0 3 } and {02 U 0 3 }. Because the ratios are (taking for example £ = 
0 . 001 ) 

R(6 l U 0 2 ,X(3)) = R(0t U 03,X(3)) = R(02 U 6 3 ,X(3)) = 3 = 0.3333 

In this case, HPR cannot work directly when £ = 0. This shows the necessity for 
the use of £ > 0. The bba’s obtained from HPR £=0 .ooi and k-l-x are listed in 
Table 2. 

From the results of Examples 1 & 2, we can see that based on k-l-x, the users 
can control the number of focal elements but cannot control the maximum cardinal- 
ity of focal elements. Although based on k-l-x, the number of focal elements can 
be reduced, the focal elements with big cardinality might also be kept. This is not 
good for further reducing computational cost. But with the proposed HPR method, 
users can easily control both the non- specificity of approximated bba’s and the focal 
element’s size. 
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Table 2 Experimental results of Example 2 (£ = 0.001) 



Focal elements 


m h(k)(‘) “ approximate bba 


m(‘) obtained by k — l—x 


II 


k = 2 


k= 1 


II 

II 

ON 


II 

II 

U4 




0.0000 


0.0000 


0.0503 


0.0000 


0.0000 


e 2 


0.0000 


0.0000 


0.0503 


0.0000 


0.0000 


03 


0.7000 


0.7000 


0.8994 


0.7000 


0.7000 


01 U 02 


0.0000 


0.1000 


0.0000 


0.0000 


0.0000 


01 U 03 


0.0000 


0.1000 


0.0000 


0.0000 


0.0000 


02 U 03 


0.0000 


0.1000 


0.0000 


0.0000 


0.0000 


01 U 02 U 03 


0.3000 


0.0000 


0.0000 


0.3000 


0.3000 



5.3 Example 3 

In this work, an approximation method 1 (giving m\ (.)) is considered better than a 
method 2 (giving m2(.)) if both conditions are fulfilled: 1) if the distance between 
mi(.) and original bba m(.) is smaller than the distance between m 2 (.) and origi- 
nal bba m(.), i.e. d(mi,m) < d(m 2 ,m); 2) if the approximate non- specificity value 
U (mi) is closer (and lower) to the true non- specificity value U (m) than U (m 2 ). We 
have used Jousselme’s distance [7] which has been proved recently to be a strict 
distance metric because it is commonly used in applications. The Non-specificity 
[4] is given by U(m) = w(A)log 2 |A|. In this example, we make a compari- 
son between HPR (method 1) and k - additive approach (method 2). We have taken 
0 = {0 1 5 0 2 , e 3 , 0 4 , 0 5 } and generated randomly 30 bba’s using the algorithm given in 
[7]. We compute and plot d(mi,m), J(m 2 ,m), U (m), U (mi) and U (m 2 ) for several 

levels of approximation. The results are shown in Fig. 1 and indicate clearly the 
superiority of HPR over the k-additive approach. 



Max FS =4 



MAX FS =3 



1.4 

I 1 - 3 

o 

g. 1.2. 

co 

1 





1.4 






1.4 




1.3 






1.2 




1.2 










h.1 






y i 


X A 


1 


* 


Wif- 


V 0.8 




0.9 










10 20 30 ' 0 



10 20 
bba’s 



10 20 30 

Q non-specificity 
of original bba’s 
-A - k-additive 

-•-HPR 




Fig. 1 Results for the Example 3. Comparison of additive belief function approximation 
with HPR approximation method. (FS means Focal element Size) 
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6 Conclusions 

In this paper, a novel bba approximation called HPR has been proposed as an 
interesting alternative approach to two classical ones. With this HPR, the non- 
specificity degree can be easily controlled by the users. Our example show its be- 
havior and advantage in comparisons with other well-known bba approximation 
approaches. HPR has a low computational cost compared with k - additive approach, 
which will be discussed in a more detailed paper in future. In further works, we will 
also compare our proposed HPR with more bba approximation approaches avail- 
able in the literature. In this paper, we have used only the distance of evidence 
and the non- specificity criteria, which in fact are not enough, or comprehensive 
to evaluate efficiently bba approximations. So in future, we will try to propose 
more efficient evaluation criteria to evaluate and design better bba approximations 
(if possible). 
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